Audio/video system having touch responsive function display screen

ABSTRACT

An audio/video editing system presents different menus of editing functions on a display screen and changes the menus as well as performing different editing functions in response to the touching of selected areas of the display screen by an operator. An arrangement of light emitting diodes and photodetectors provides a network of beams across the face of the display screen. Selected beams are interrupted when the operator points his finger at particular characters being displayed on the screen. The display menus and editing functions are controlled by an edit controller which includes a central processing unit having a memory loaded with data from a computer file system, a character generator for providing the various menus on the display screen and a plurality of intelligent line controllers coupled to a plurality of source tape recorders, a record tape recorder and a switcher capable of coupling a different one of the source recorders to the record recorder. Each intelligent line controller which includes its own processing unit and memory controls the flow of data between the central processing unit and the various recorders and the switcher in addition to converting the data between parallel and serial forms. A separate interface coupled between each of the intelligent line controllers and an associated one of the recorders or the switcher includes processors which convert the data into a form usable by the recorder or switcher.

This application is a continuation of application Ser. No. 509,097,filed June 28, 1983 (abandoned), which is a continuation of applicationSer. No. 252,571, filed Apr. 9, 1981 (also abandoned).

BACKGROUND OF THE INVENTION

Over the years audio/video editing systems have developed into complexand sophisticated arrangements for manipulating video and audioinformation recorded therewith in a desired fashion. In a typicalediting system selected video or audio information from a plurality ofdifferent inputs is recorded on a record audio/video tape recorder underthe careful control of an operator. The information to be recorded istypically contained in one or more of a plurality of source taperecorders but can also come from other input sources such as amicrophone or video camera. A switcher coupled between the record taperecorder and the source tape recorders and any other input devicesresponds to editing commands to control the exact information recordedby the record tape recorder. Proper synchronization during the recordingoperation characterizing a typical editing process is maintained byreference to a coded reference track which accompanies each recording ontape and which identifies each frame of the recording. Such referencetracks typically involve the use of time code (recorded either directlyon the reference track within the video tracks during the verticalinterval, or a combination of both) as specified in various documents bythe Society Of Motion Picture And Television Engineers (SMPTE) and theEuropean Broadcasting Union (EBU).

In a typical editing operation the operator manipulates a keyboard whileviewing a video monitor which provides a visual display of the videoinformation being recorded on the record tape recorder. The keyboard istypically a designated keyboard, meaning that it is comprised ofdifferent keys representing specific editing functions. The keys may bearranged in an ASCII format or in any other format which is convenient.Keys arranged in the ASCII format are also designated by lettersarranged in a conventional typewriter keyboard format so that thevarious different editing functions can be selected largely by feel andbased on experience and memory, much in the same manner as anexperienced typist types.

As editing systems have become more sophisticated and complex, thekeyboards used therewith have grown larger and more confusing. It is notunusual, for example, to have an editing keyboard comprised of more than100 keys, each representing a different editing function or type offunction. As a result considerable time and experience are required witha given machine before the operator can perform editing functionsquickly and efficiently. However, even in cases where the operator isexperienced and totally familiar with a given editing system, there isan inherent problem with conventional editing systems in that themechanical considerations imposed by a fixed keyboard with so manyfunctions seriously detract from the creative aspects of editing. Timecode representations of edit entry and exit points are typically reliedupon rather than editing in accordance with the picture itself.

A further limitation of many conventional editing systems resides in theconfinement of system intelligence to one central location. Thosesystems employing a central processor or other processing unit inconjunction with the editing functions typically concentrate limitedprocessing equipment at one central location, thereby restricting futureflexibility of a particular system.

Over the years various attempts have been made at improving thehuman-machine interface involved in editing. One such approach, forexample, involves the use of a light pen. The pen is manipulatedrelative to a responding member to select certain editing functions,thereby reducing the number of buttons needed. At best, however, suchsystems replace keyboard buttons with the light pen, requiring that theoperator pick up and handle the light pen with each operation.

Accordingly, it would be desirable to provide an editing system withimproved human-machine interfacing so as to facilitate the artisticaspects and approach to video editing.

It would furthermore be desirable to provide an editing system capableof displaying different menus of editing functions to be chosen from bythe operator.

It would furthermore be desirable to provide an editing system capableof accommodating varying numbers and types of information inputs.

It would still furthermore be advantageous to provide an editing systemcapable of intelligent operations at peripheral portions of such systemin addition to a central portion of the system.

BRIEF DESCRIPTION OF THE INVENTION

The above and other objects are accomplished in accordance with theinvention by providing an editing system capable of displaying differentmenus of editing information and selections on a display screen. Thedisplay screen is responsive to the touching of selected areas thereofby the operator so as to change the menus and at the same timeaccomplish desired editing functions. The presentation of a limited menuof editing information and selections at any given instant enables theoperator to concentrate on a particular type or types of editingoperations being performed. At the same time, however, considerableversatility is afforded in that the operator can choose the level atwhich he desires to work and can change each menu as he sees fit so asto combine levels and afford the custom designing of menus withvirtually unlimited possibilities.

The versatility and character of operation of editing systems inaccordance with the invention are enhanced by utilizing a systemarrangement which places intelligent capabilities at peripherallocations as well as at a central location. In this manner a singlecentral processor can communicate with a variety of different inputequipment virtually simultaneously. Proper interfacing equipmentprovides for the conversion of data into a machine usable form tailoredto the particular requirements of input and output peripheral equipment.

In a preferred arrangement of an audio/video editing system inaccordance with the invention a data monitor comprising a cathode raytube or other display screen device is coupled to an edit controllerfrom which it receives the different menus of editing information andselections. The display screen is equipped with apparatus for providinga network of interruptable beams thereacross. When the operator pointsto a particular character or group of characters on the display screen,the beams in this area of the display screen are interrupted and acorresponding signal is provided to the edit controller. The editcontroller which is comprised of a central processing unit, a memory anda character generator responds by making appropriate changes in the menuprovided the visual display. The character generator coupled to thecentral processing unit provides the various characters comprising thedifferent menus displayed on the data monitor. At the same time thecentral processing unit together with its associated memory providesdata to other portions of the editing system to accomplish editingfunctions commanded when the operator touches particular portions of thedisplayed menus. In addition to the touch responsive data monitor, theediting system can be provided with one or more conventional keyboardsalso capable of providing editing information and selections to the editcontroller.

The edit controller includes a plurality of intelligent line controllerscoupled to the central processing unit. One of the intelligent linecontrollers is coupled to the touch sensitive apparatus associated withthe data monitor. Another one of the intelligent line controllers iscoupled to a record tape recorder on which the material being edited isrecorded. Another one of the intelligent line controllers is coupled toa switcher. The remaining ones of the intelligent line controllers areeach coupled to a different input information source. The inputinformation sources can comprise such things as video cameras or audiomicrophones but are typically comprised of source tape recorders. Theswitcher is coupled between the record tape recorder and the variousinput sources such as the source tape recorders to control coupling ofthe input sources to the record tape recorder. Each of the intelligentline controllers which includes its own processing unit and memory iscapable of performing intelligent functions in locations remote from thecentral processing unit. In addition to converting parallel data fromthe central processing unit to a serial data form and vice versa, eachintelligent line controller acts as a data buffer between the centralprocessing unit and the various tape recorders and other peripheralequipment. The intelligent functions performed by the intelligent linecontrollers enable the central processing unit to communicate with thevarious pieces of peripheral equipment virtually simultaneously. Theresult is an open-ended editing system capable of being coupled to inputdevices of varying numbers and types. The various input devices such asthe source tape recorders as well as the switcher and the record taperecorder are coupled to the various intelligent line controllers throughinterfaces which serve to convert the serial data from the intelligentline controllers into a form usable by the particular recorder or otherdevice coupled thereto.

BRIEF DESCRIPTION OF THE DRAWINGS

The foregoing and other objects, features and advantages of theinvention will be apparent from the following more particulardescription of a preferred embodiment of the invention, as illustratedin the accompanying drawings, in which:

FIG. 1 is a perspective view of an audio/video editing system inaccordance with the invention;

FIG. 2 is a perspective view of the data monitor of the editing systemof FIG. 1 showing the touch responsive apparatus used in conjunctiontherewith;

FIG. 3 is a block diagram of the editing system of FIG. 1;

FIG. 4 is a block diagram of the human interface portion of the editingsystem of FIG. 3;

FIG. 5 is a block diagram of the different basic functions performed bythe edit controller of the editing system of FIG. 3;

FIG. 6 is a block diagram of a portion of the editing system of FIG. 3showing the edit controller in greater detail;

FIG. 7 is a block diagram of one of the video machine interfaces of thearrangement of FIG. 6;

FIG. 8 is a block diagram of one of the intelligent line controllers ofthe arrangement of FIG. 6;

FIG. 9 is a block diagram of the switcher and effects generator of thearrangement of FIG. 6; and

FIG. 10 is a flow chart showing the manner in which the editing systemuses the data monitor and touch responsive apparatus to convert userdecisions into editing actions.

DETAILED DESCRIPTION

FIG. 1 depicts a video editing system 10 in accordance with theinvention. The video editing system 10 is mounted on or contained withina desk 12 and includes a touchscreen data monitor 14 and a video monitor16 mounted on the top of the desk 12. Also mounted on the top of thedesk 12 is a joystick panel 18. A designated keyboard 20 or a designatedkeyboard 22 having keys arranged in an ASCII format, both of which areshown in FIG. 1, can also be used to provide alternative humaninterfaces with the system 10.

The video editing system 10 of FIG. 1 can have up to three differenthuman interfaces which are comprised of the touchscreen data monitor 14,the designated keyboard 20 and the ASCII keyboard 22, each utilizing ajoystick panel 18. The joystick panel 18 has several control buttonsthereon plus a joystick. When control of a particular tape transport isobtained by one of the human interfaces 14, 20 and 22, the joystickpanel 18 may be used to control the operation of that transport. Thedesignated keyboard 20 may be of conventional design and includes all ofthe various keys and controls needed to perform the various editingfunctions used in a modern, sophisticated editing system. The ASCIIkeyboard 22 has the various keys thereof arranged in conventionaltypewriter format so that the various editing functions can be touchtyped into the system 10 by the operator. The keyboards 20 and 22comprise two different alternative ways in which the editing system 10can be controlled by the operator. The touchscreen video monitor 16provides a picture of the video information being recorded on a recordtape recorder as editing is carried out by the operator.

In accordance with the invention a superior and highly advantageoushuman interface with the editing system 10 is provided by thetouchscreen data monitor 14. As shown in detail in FIG. 2, thetouchscreen data monitor 14 is comprised of a cathode ray tube 26 havinga display screen 28 at the front thereof. Mounted adjacent the displayscreen 28 is a touch input system 30. The touch input system 30establishes a pattern of interruptable beams across the face of thedisplay screen 28 using light emitting diodes and photodetectors. In thepresent example the touch input system 30 is of the type manufactured byCarroll Manufacturing Company of Champaign, Ill. and includes twodifferent pluralities of light emitting diodes 32 and 34 on the leftside and bottom of the display screen 28 respectively. The touch inputsystem 30 also includes a first plurality of photodetectors 36 on theright-hand side of the display screen 28 opposite the light emittingdiodes 32 and a second plurality of photodetectors 38 along the top ofthe display screen 28 and opposite the light emitting diodes 34. Thelight emitting diodes 32 emit infrared rays which extend in generallyparallel fashion across the face of the display screen 28 to thephotodetectors 36. Each one of the light emitting diodes 32 correspondswith a particular one of the photodetectors 36 so that the infrared rayfrom the light emitting diode falls upon the photodetector. In likefashion the light emitting diodes 34 emit infrared rays which extendupwardly along the face of the display screen 28 in generally parallelfashion to the photodetectors 38.

The light emitting diodes 32 and 34 and the photodetectors 36 and 38establish an X-Y coordinate system of beams or rays across the face ofthe display screen 28. When the operator touches a particular locationon the display screen 28 as shown in FIG. 1, one or more of the infraredrays from the light emitting diodes 32 and 34 are interrupted. A controllogic box 40 which is coupled to the photodetectors 36 and 38 respondsby providing a signal representative of the particular location on thescreen 28 touched by the operator. The control logic box 40 does this bydetermining the average Y location of the infrared rays from the lightemitting diodes 32 which are broken and by determining the average Xlocation of the infrared rays from the light emitting diodes 34 whichare broken. The resulting output signal from the control logic box 40thus represents the average X and Y position of the area on the displayscreen 28 touched by the operator. The control logic box 40 is ofconventional design and may be designed or purchased separately or inconjunction with the light emitting diodes 32 and 34 and thephotodetectors 36 and 38 as part of a complete touch input system 30.

The particular touch input system 30 shown and described is for purposesof illustration only, and it should be understood that other touchsystems which are capable of providing an output signal indicating anarea touched on the display screen 28 can be used. Other touch systemswhich can be used include a variety of different manufactured productssuch as those employing a conductive glass and plastic laminate, thoseemploying acoustic waves and those in which a conductive pattern isetched on the display screen.

As will become more fully apparent from the discussion to follow, thedata monitor 14 with its included touch input system 30 provides ahighly versatile and advantageous human interface with the editingsystem 10. The editing system 10 is capable of displaying any one of aplurality of different menus of editing information and selections onthe data monitor 14. The operator then chooses one or more of theediting selections by touching the characters on the display screen 28which describe or represent such selections. Each time the displayscreen 28 is touched by the operator, the resulting output signal fromthe control logic box 40 is applied to a portion of the editing system10 which compares such information with the characters displayed on thescreen to determine the particular function selected by the operator.The system 10 then executes any required editing functions and at thesame time changes the information displayed on the screen 28. Suchchanges may be accomplished by displaying an entirely new menu ofinformation and selections on the monitor 14 or by simply modifying theoriginal menu displayed. This enables the operator to concentrate onediting from the standpoint of different levels or different types offunctions. Also, because the makeup of a particular displayed menu isvirtually unlimited, a great amount of versatility and flexibility isintroduced into the editing system 10.

FIG. 3 depicts a block diagram of the editing system 10. The editingsystem 10 includes a human interface 42 which is shown in FIG. 4 asbeing comprised of the joystick panel 18 and the designated keyboard 20,the ASCII keyboard 22 and the touch input system 30. The human interface42 is coupled to an edit controller 44 as is the touchscreen datamonitor 14. Each time one of the keys or other controls on the panel 18or the keyboards 20 and 22 is manipulated or the touch input system 30senses the touching of an area on the display screen of the data monitor14, a corresponding signal is provided to the edit controller 44. Inaddition to providing the menus of editing information and selections tothe data monitor 14, the edit controller 44 controls all other portionsof the editing system 10 including three different source audio/videotape recorders 46, 48 and 50, a record audio/video tape recorder 52 anda switcher and effects generator 54. Each of the source audio/video taperecorders 46, 48 and 50 provides a different audio and video input tothe switcher and effects generator 54. The switcher and effectsgenerator 54 responds to commands from the edit controller 44 to coupleone or more of the audio and video signal inputs thereto to the recordaudio/video tape recorder 52. The video information recorded on therecord audio/video tape recorder 52 is also applied to a previewswitcher 56 controlled by the edit controller 44. The preview switcher56 in turn provides the video information for display on the videomonitor 16. The preview switcher 56 is required for certain types oftape recorders when used as the record audio/video tape recorder. Stillother types of tape recorders eliminate the need for the previewswitcher 56. The edit controller 44 is also coupled to control a printerand paper tape system 58.

A floppy disk system 60 is coupled to the edit controller 44 so as toboth input data to and receive data from the edit controller 44. Thefloppy disk system 60 comprises one example of a mass storage mediumwhich can be used for this purpose, with various other types of massstorage media being usable for this purpose. Initially, instructions forthe various menus to be displayed on the data monitor 14 and the variousediting functions which are recorded on a floppy disk are loaded fromthe disk system 60 into the edit controller 44. Thereafter, as editingfunctions are performed certain information defining the location andnature of different editing functions performed along the length of thetape within the record audio/video tape recorder 52 may be outputed bythe edit controller 44 for storage in the floppy disk system 60.Alternate mass storage systems may store the information in an on-boardPROM or a CCD memory.

After the menus and other information are loaded into the editcontroller 44 from the floppy disk system 60, the edit controller 44provides an initial menu of information and selections on the datamonitor 14. When the operator responds by punching a key on the one ofthe keyboards 20 and 22 or by touching the display screen 28 of the datamonitor 14, the signal is sent from the human interface 42 to the editcontroller 44. The edit controller 44 identifies the edit functionrepresented by the signal, and then, if necessary, changes the displayon the data monitor 14 by either making changes in the present menu orby providing a new menu to the data monitor 14. At the same time anyedit functions to be performed within the system 10 are carried outunder the control of the edit controller 44. For example, where videoinformation from one or more of the source recorders 46, 48 and 50 is tobe recorded on the recorded recorder 52, the edit controller 44 controlsthose of the source recorders 46, 48 and 50 involved, the recordrecorder 52 and the switcher and effects generator 54. The processing ofthe various different video information is carefully synchronized usingthe time code or control track recorded on the various lengths of tapeand which identifies the recordings on a frame-by-frame basis. The editcontroller 44 continues to respond to inputs from the human interface 42and to change the menus on the data monitor 14 and effects editingfunctions accordingly until all editing operations have been completed.

As previously noted the edit controller 44 controls the source recorders46, 48 and 50, the record recorder 52 and the switcher and effectsgenerator 54. The edit controller 44 has a choice of cuts, keys,dissolves and special effects. Cue points are selected manually tocontrol tape speed and direction. Edit-in and edit-out points are markedmanually in this mode of operation. If desired, cue points can also beselected by entering time code values for entry and exit points. Valuesfor pre-roll and post-roll are also entered, as well as dissolve andspecial effect duration.

The source audio/video tape recorders 46, 48 and 50 are coupled to theedit controller 44 via machine interfaces 62, 64 and 66 respectively.The record audio/video tape recorder 52 is coupled to the editcontroller 44 by a machine interface 68. The printer and paper tapesystem 58 is coupled to the edit controller 44 by an interface 70. Theswitcher and effects generator 54 is coupled to the edit controller 44by a switcher interface 72. The various interfaces 62, 64, 66, 68, 70and 72 serve to convert the data communicated from and to the editcontroller 44 between a serial form as it appears at the output of theedit controller 44 and a form which is usable by the particular recorderor other component to which the interface is coupled. For example, oneparticular type of tape recorder requires a DC voltage ranging from 0volts to +10 volts to control forward and reverse tape motion, while adifferent type of tape recorder requires a signal varying in frequencyto control tape motion. The various interfaces perform the appropriateconversion of the data from the edit controller 44 into such forms. Atypical interface is described in detail in connection with FIG. 7.

FIG. 5 depicts the basic functions performed by the edit controller 44,while FIG. 6 depicts the controller 44 in detail. Referring first toFIG. 6, it will be seen that the edit controller 44 includes a centralprocessing unit 74 and an associated memory 76. The memory 76 includesboth read only memory (ROM) portions and random access memory (RAM)portions. The central processing unit 74 is coupled to the floppy disksystem 60 through a disk controller 78. The central processing unit 74is also coupled to the human interface 42 through a character generator80 which sends an output to the data monitor 14 representing theinformation being displayed on the monitor 14. When the information fromthe floppy disk within the floppy disk system 60 is loaded into the editcontroller 44, such information is stored in the memory 76. The centralprocessing unit 74 responds to the signals from the human interface 42applied thereto via an intelligent line controller 82 and a data bus 84.Based on the signals communicated from the human interface 42, thecentral processing unit 74 performs any editing functions within thesystem 10 that are dictated by the signals. At the same time, thecentral processing unit 74 causes the menu presently being displayed onthe data monitor 14 to change or a new menu to be presented if needed.This is accomplished by determining the desired characters to bedisplayed on the data monitor 14 from the memory 76 and providing suchcharacters to the character generator 80. The character generator 80which stores the various characters in a dot matrix format responds tocharacters outputed from the memory 76 by causing the display of thedesired characters on the monitor 14.

Included in the data stored in the memory 76 from the floppy disk system60 are overall instructions referred to as the operating system 86 inFIG. 5. The operating system 86 controls four separate processesreferred to as command generator 88, display generator 90, input/outputcontrol 92 and machine control 94. The four different processes 88, 80,92 and 94 are carried out in parallel under the control of the operatingsystem 86. The command generator 88 responds to signals from the humaninterface 42 by determing what is to be done. This results in thegeneration of data which is entered in a common data base 96. Thedisplay generation process 90 involves the evaluation of the dataentered in the common data base 96 to determine what is to be displayedon the data monitor 14. The display generator 90 provides any neededdata in connection with changes in the display to the charactergenerator 80. The input/output control process 92 provides for thecontrol of the printer/paper tape system 58 and file system as well asany other peripheral equipment aside from the various tape recorders andswitchers. The machine control process 94 responds to data entered inthe common data base 96 by determining what actions are to be taken bythe source tape recorders 46, 48 and 50, the record tape recorder 52 andthe switchers. This results in appropriate commands being provided bythe edit controller 44 to the tape recorders and switchers.

Because the editing process has become increasingly sophisticated, theefficient use of costly on-line editing time has become a majorpriority. Edits which are constructed and previewed on less costlyoff-line time, on the other hand, must have their parameters recordedfor future reference, reproduction or transfer to on-line equipment. Toprovide for this a list of such editing decisions is stored togetherwith all the parameters necessary to carry them out. Such informationcan be stored in the floppy disk system 60, in the memory 76 or in theprinter and paper tape system 58 shown in FIG. 3. If an editing sessionis interrupted, the editing decisions and parameters can be temporarilystored in one of such locations for later reloading and completion. Oncethe edit construction is complete, such information can be used topreview the edit or to transfer such edits to on-line equipment.

Referring again to FIG. 6 the central processing unit 74 may becomprised of any appropriate central processing unit such as the singleboard central processing unit sold under the designation LSI-11 byDigital Equipment Corporation. The memory 76 preferably has a RAMcapacity of 64K bytes or more. A timing generator 98 generates systemtiming signals for the edit controller 44. As previously discussed thetouch input system 30 functions in conjunction with the touchscreen datamonitor 14 to perform various functions in response to being touched bythe operator. These functions include system operation, the entry ofdata and the changing of an edit decision. The joystick panel 18 is usedin conjunction with the touch input system 30 to provide for manualtransport control and edit entry/exit point selection. The joystickpanel 18 can also be used in conjunction with the designated keyboard 20or the ASCII keyboard 22. Together the keyboard 20 or 22 and the panel18 allow the operator to enter system edit data, select menus, trim editpoints, and control transport operation. The designated keyboard 20 hasspecial purpose keys for specific system operations. All systemoperating functions are controlled by dedicated keys such as preview,edit, search, cue, rewind, play mark entry/mark exit, key dissolve, andset/trim entry/exit. In addition, soft keys on the designated keyboard20 may be used by the editor to define functions which may change fromedit to edit. Each such soft key can be used to control the editcontroller 44 in a manner similar to the operation of the touch inputsystem 30 to change items on a menu presented by the data monitor 14 orto change menus.

The switcher and effects generator 54 may be used to select a cut,dissolve, key or one of many different wipe patterns. The wipe patternsoccur from one source to another, with selection of hard or soft edgesbeing possible. All effects are reversible in direction. The key modeprovides fade-up or fade-down of a keyed foreground into a background.The key input effectively cuts a hole in the background in the shape ofthe video to be keyed, such as a title or graphic. The foreground of thekey fills the hole in the background. Fade durations are selectable.During all effects except keys, audio is dissolved from one source toanother.

In order to understand the nature of the different menus displayed onthe data monitor 14, it will be helpful to consider a particular exampleof an editing system 10 having both primary menus and secondary menus.The primary menus are designed to accomplish the more commonly performedediting tasks. They typically display a moderate amount of information,allowing the editor to keep track of numerous steps without changingmenus while at the same time limiting the total information displayed onany one menu in order to avoid confusion and clutter. There are sixprimary menus which include the following:

1. System Parameters--This is the first menu to appear on the datamonitor 14 after the editing system is turned on. It is used primarilyas a reference point, or dispatcher, from which to select other menusfor editing. General system set-up controls are typically located onthis menu.

2. Edit Decision List--This menu displays a portion of the current editdecision and provides the control to modify it. Also displayed arecontrols for previewing edits with the switcher 54.

3. Edit Decision List Configuration--This menu is used to select theedit decision parameters. The menu lists all parameters that may be usedas headings on the edit decision list and their current configuration.The menu retains multiple versions of the edit decision list headingsand provides the controls to add, remove, or rearrange parameters withinthe edit decision listings.

4. Edit Construction--This menu comprises an active display of theparticular edit under construction. It indicates and allows the operatorto select in-edit and out-edit points, transports, reels, and effects.This menu can be combined with a number of secondary menus toaccommodate more specific editing requirements.

5. Transport Configuration--This menu provides for selection and thedisplay of the status of transport parameters such as logical order,intelligent line controller channel, interface type, reel number andtransport status.

The secondary menus in the present example are designed for discrete,specialized editing functions and are not included in the primary menus.All secondary menus except for a numerical keypad appear as additions tothe lower portion of the primary menus. The keypads cause the operatorto enter numerical data such as pre-roll and post-roll duration.Transport controls for the video tape recorders provide play, rewind,fast forward, search and shuttle functions. Special effects are carriedout with a variety of flexible controls. Split edit modes of audio andvideo may be selected from different points on the source video tapes.Controls for preview edits, cuts, dissolves, wipes, fades to or fromblack and key modes with programmable duration are included, as well ascontrols over rolls.

FIG. 7 shows the details of a typical one of the interfaces such as themachine interfaces 62, 64, 66 and 68. As previously noted each suchinterface provides bidirectional communications between the controller44 and the recorder being controlled. The input to the interfaceincludes a pair of serial data lines 100 and 102. The line 100 providesserial data from a serial data processor 104 to the edit controller 44.Conversely, the line 102 provides serial data from the edit controller44 to the serial data processor 104. The serial data processor 104includes a universal asynchronous receiver transmitter which convertsincoming serial data to parallel form before applying it to a CPU andMemory 105. A personality module 106 is peculiar to the particularperipheral device being interfaced such as a tape recorder 108. Thepersonality module 106 translates the parallel data from the CPU andMemory 106 into transport commands in proper form for use by the taperecorder 108. As previously noted different peripheral devices requiredifferent types of signals. For example some tape recorders require a DCvoltage to control capstan speed, while others require an AC signalwhose frequency determines tape speed.

The tape recorder 108 is coupled to the CPU and Memory 105 both throughthe personality module 106 and a time code processor/reader 110. Theconnection from the tape recorder 108 to the time code processor/reader110 provides communication for the time code track between the tape andthe time code processor/reader 110. Typically, the time code track isread from the tape on the tape recorder 108 and passed to the time codeprocessor/reader 110 where it is decoded from a serial bit stream toparallel data.

Output signals from the interface of FIG. 7 to the edit controller 44consist of transport tally signals, status signals and time code data.Tally and status signals are buffered and then passed to the data bus 84within the edit controller 44. Serial time code data is converted toparallel data by the time code processor/reader 110 as previously noted.This data is then communicated to the edit controller 44.

Referring again to FIG. 6 it was previously noted that the humaninterface 42 is coupled to the central processing unit 74 by anintelligent line controller 82. In the present example the editcontroller 44 includes the intelligent line controller 82 and threeadditional intelligent line controllers 112, 114 and 116. Theintelligent line controller 112 couples the central processing unit 74to the machine interface 62. The intelligent line controller 114 couplesthe central processing unit 74 to the switcher interface 72. Theintelligent line controller 116 couples the central processing unit 74to the machine interface 68. Each of the intelligent line controllers82, 112, 114 and 116 comprises an intelligent communications interfacebetween the edit controller 44 and external peripheral apparatus such asthe audio/video tape recorders and the human interface 42. Data from thecentral processing unit 74 communicated on the data bus 84 is inparallel form. Each of the controllers 82, 112, 114 and 116 converts thedata to serial form before applying the data to the peripheralapparatus. Conversely, data communicated from the peripheral apparatusto the central processing unit 74 is converted from serial to parallelform by the various controllers 82, 112, 114, and 116. In addition toconversion by the data form, the various controllers 82, 112, 114, and116 act as buffers between the peripheral apparatus and the centralprocessing unit 74. The intelligent line controllers also verify datainput formats, convert data formats and perform certain primitivecontroller functions such as automatic time code and status requests.The central processing unit 74 cannot communicate with two or morepieces of peripheral apparatus simultaneously. However, the effect ofthe presence of the various controllers is to provide for substantiallysimultaneous communication by receiving and holding data until thecentral processing unit 74 is free to receive such data.

The various intelligent line controllers 82, 112, 114 and 116 areidentical in construction with one of them being shown in FIG. 8. Theintelligent line controller shown in FIG. 8 includes a first bustransceiver 118 coupled to the central processing unit 74 to communicateaddress and data between the intelligent line controller and the centralprocessing unit 74. The bus transceiver 118 is coupled to an ILC CPU 120by an address bus 122 and a data bus 124. The address bus 122 is alsocoupled to a 4K RAM 126 and to a 1K ROM 128. The data bus 124 is alsocoupled to the 4K RAM 126 and to the 1K ROM 128. A second bustransceiver 130 is coupled to the central processing unit 120 via acontrol bus 132 and to the central processing unit 74 and is operativeto handle timing and control requests communicated between theintelligent line controller and the central processing unit 74.

An address comparator 134 has two different inputs, one from the bustransceiver 118 and the other from a board address select switch group136. The address comparator 134 compares the contents of the addressreceived from the central processing unit 74 with the setting of theboard address select switch group 136. If a valid comparison is made,the comparator 134 requests control of the data and address buses 122and 124 from the ILC CPU 120. When such control is relinquished by theintelligent line controller, data is transferred from the centralprocessing unit 74 to the intelligent line controller RAM 126. The ILCCPU 120 in turn formats the data in the RAM 126 and then transmits thedata via a universal asynchronous transmitter 138 to the interface asshown in FIG. 7. Incoming serial data from the interface is converted toparallel form by the universal synchronous receiver transmitter 138,which generates and communicates an interrupt signal to the ILC CPU 120.When the ILC CPU 120 services the interrupt signal, the incoming data isformatted and written in the RAM 126. The new data in the RAM 126 isthen read by the central processing unit 74 by requesting bus controlfrom the ILC CPU 120 and reading the data. The frequency at which theserial signals from the universal asynchronous receiver transmitter 138are communicated to the interface is determined by a baud rate generator140 in conjunction with a baud rate select switch group 142.

The switcher and effects generator 54 is shown in detail in FIG. 9. Theintelligent line controller 114 associated with the switcher 54 iscoupled through the switcher interface 72 to the switcher 54. Theswitcher interface 72 which may be of like construction to that shown inFIG. 7 is coupled to receive composite sync and composite blankingsignals. The switcher interface 72 has an address bus 144 and a data bus146 at the output thereof. The buses 144 and 146 are coupled to a videoprocessor/mixer 148 at the output of the switcher 54 by either a videocrosspoint circuit 150 or a waveform generator 152 and a video processor154. The buses 144 and 146 are also coupled to an audio crosspointcircuit 156.

The switcher and effects generator 54 is used principally for mixing andwiping operations. In the case of a mixing operation one of the inputsto the audio crosspoint circuit 56 and one of the inputs to the videocrosspoint circuit 150 are applied to the video processor/mixer 148. Thevideo processor 154 is also used in such operation. A wiping operationis performed using the waveform generator 152 and the video processor154.

FIG. 10 is a flow chart depicting the manner in which the editing system10 uses the data monitor 14 together with the touch input system 30 toconvert decisions by the operator into editing actions.

In a step 160 depicted in FIG. 10, the system 10 creates via the editcontroller 44 a list of valid choices to be presented to the operator.At different points in an editing process, a different set of operatorrequests is considered valid. The edit controller 44 first determinesthis set of choices in the step 160. Usually, this is a function of thetype of action currently being performed. In addition, the editcontroller 44 may have to examine information received from othertransports or sources as well as information previously stored in thememory 76.

In a next step 162, each valid choice is displayed on the screen 28 ofthe data monitor 14. Associated with each choice in the set of validchoices are several important pieces of information. One of these is adescription of where on the screen 28 the choice should be presented tothe operator. An additional piece of information is what label should beprinted on the screen 28 so that the operator is able to identify andunderstand the choice. Once a valid set of choices has been assembled,each label is displayed at its corresponding position on screen 28. Theoperator is thus made aware of what the current set of choices consistsof and is expected to now select one of them.

In a next step 164, the screen 28 of the data monitor 14 is scanned anda decision 166 is made as to whether or not a beam has been broken. Whenthe operator has determined which of the labels displayed on the screen28 corresponds to the action he wants the editing system 10 to take, heplaces a finger (or other object) on that label on the screen 28. Aspreviously noted, the light emitting diodes 32 and 34 mounted adjacentthe screen 28 emit infra-red beams which are directed onto correspondingones of the photodetectors 36 and 38. Placement of the operator's fingerat a particular location on the screen 28 results in one or more of thephotodetectors 36 sensing interruption of the infrared beams normallyreceived thereby. By periodically examining the outputs of thephotodetectors 36 and 38, the editing system detects the presence of afinger. By assigning numeric values to the various photodetectors 36 and38, the editing system can also calculate numbers which represent thehorizontal and vertical coordinates of the finger on the screen 28. As aresult of the periodic examination of the outputs of the photodetectors36 and 38, the decision 166 indicates whether or not one or more of theinfrared beams have been broken.

If the decision 166 is that one or more of the infrared beams have beenbroken, then in a next step 168 the distance from the finger to each ofthe choices displayed on the screen 28 is calculated. It was previouslynoted that each choice displayed on the screen 28 has associated with itan indication of a position on the screen where it is displayed. Eachelement in a set of choices is examined and the distance between theposition associated with that choice and the position of the finger iscalculated. The choice which has the smallest distance from the positionof the finger is assumed to be the one intended by the operator. If thefinger is too far away from the nearest choice, no action is taken.These actions are represented by a decision 170 shown in FIG. 10.

If the decision 170 results in a "yes" determination indicating that thefinger has been placed at least within a nominal distance of one of thechoices and that choice has been determined to be the one desired by theoperator, the value associated with that choice is computed in afollowing step 172. Associated with each choice in a set of determinedchoices is a value. During the step 172 the value associated with thechoice selected by the operator is determined. Using this value, theediting system 10 performs the desired action which is depicted in afollowing step 174 in FIG. 10. The value determined in the step 172corresponds to the type of signal provided when either the designatedkeyboard 30 or the ASCII keyboard 22 is utilized.

The various operations depicted in the flow charts of FIG. 10 can bebetter understood by considering an example. If it is assumed that at aparticular point in an editing session the operator is expected to entera digit between 0 and 9, then under these conditions there are tenpossible choices. Associated with each of the choices is a position onthe screen 28 of the data monitor 14. Each choice has a label printed onthe screen 28 so that the numerals "1", "2", "3", etc., are displayed onthe screen. If the operator wants to select the numeral "7", he places afinger on the screen 28 at the place where the label "7" has beendisplayed. The infrared beams corresponding to this location are brokenand the editing system determines the horizontal and verticalcoordinates of the finger. Each of the ten possible choices is examined,and the distance between its position on the screen 28 and the positionof the finger on the screen 28 is calculated. In the present example,the choice corresponding to the numeral "7" is determined to be theclosest. Associated with each choice is a value. In the present example,the value for "7" might be the ASCII code for "7". This is the valuewhich most computer and communication equipment uses to represent a keylabeled "7". The editing system 10 now uses this value as if it had comefrom a conventional keyboard or communication device such as thedesignated keyboard 20 or the ASCII keyboard 22.

While the invention has been particularly shown and described withreference to a preferred embodiment thereof, it will be understood bythose skilled in the art that various changes in form and details may bemade therein without departing from the spirit and scope of theinvention.

What is claimed is:
 1. An audio/video editing system comprising:at leastone source recorder device for supplying a source of audio/videoinformation; a recording recorder device for recording selectedaudio/video information from the at least one source recorder device; aswitcher device for selectively coupling the at least one sourcerecorder device and the recording recorder device; computer means forproviding selected edit commands; an operator controlled input deviceincluding edit function display/indicating means for supplying serialedit function messages indicative of selected editing functions to beperformed by the recorder device and the switcher device; an operatorintelligent line controller coupled to the operator controlled inputdevice for identifying, converting and buffering the serial editfunction messages in response to the computer means edit commands toprovide corresponding parallel edit commands; a plurality of deviceintelligent line controllers coupled to the operator intelligent linecontroller for establishing communication with the respective recorderand switcher devices, and for converting and buffering the parallel editcommands to define serial edit commands, in response to the computermeans; a plurality of interfaces coupled between respective deviceintelligent line controllers and respective recorder devices andswitcher device for translating the serial edit commands to a formcommensurate with the requirements of the respective devices, and fortranslating device edit status messages from the respective devices forreturn to respective device intelligent line controllers, in response tothe computer means; and said device line controllers further convertingand buffering the returned device edit status messages in response tothe computer means.
 2. The system of claim 1 wherein thedisplay/indicating means include a cathode ray tube having a displayscreen, and indicating means responsive to the touching of a particularportion of the display screen by an operator for providing to thecomputer means a corresponding indication of selected ones of theediting functions to be performed.
 3. The system of claim 2 wherein theindicating means include means for selecting a menu of selected editingfunctions for display on the display screen in response to the editinginformation displayed at a specific location of the display screentouched by the operator.
 4. The system of claim 1 wherein each of thecontrollers is operative to convert data between parallel and serialforms to allow selectively spacing the operator controlled input deviceand the recorder and switcher devices from the respective controllersand from the computer means.
 5. The system of claim 1 wherein theoperator controlled input device further includes at least one keyboardhaving a plurality of keys thereof representing the selected editingfunctions.
 6. The system of claim 1 wherein the operator controlledinput device further includes at least one joystick panel and controlkeys for supplying additional serial edit function messages indicativeof additional editing functions.
 7. The system of claim 1 wherein theinterfaces include:a first interface coupled to the at least one sourcereceiver device; a second interface coupled to the recording recorderdevice; a third interface coupled to the switcher device; and whereineach of the interfaces include an interface serial data processor and adata conversion module responsive to the processor for converting databetween the serial form and the specific device usable forms required bythe respective devices.
 8. The system of claim 7 wherein the serial dataprocessors of each interface are coupled to the respective controllers,a time code processor is coupled to the serial data processor, and thedata conversion module is coupled from the serial data processor to therespective recorder device and switcher device.
 9. The system of claim 7wherein the device intelligent line controllers include:a first, secondand third controller coupling the respective first, second and thirdinterfaces to the operator intelligent line controller and to thecomputer means; and the controllers each being operative to convert thedata from the serial to parallel format, and vice versa, and to storethe parallel data under command of the computer means.
 10. The system ofclaim 9 wherein the controllers each include a central processing unit,a transceiver coupling the central processing unit to the computermeans, a memory coupled to the central processing unit and to thetransceiver, and an address comparator coupled between the transceiverand the central processing unit.
 11. The system of claim 10 furtherincluding a receiver transmitter coupled from the central processingunit to the respective interface and operative to convert data betweenparallel and serial form.
 12. An audio/video editing systemcomprising:at least one source recorder device for supplying a source ofaudio/video information to be edited; a recording recorder device forrecording selected edited audio/video information from the at least onesource recorder device; a switcher device for selectively coupling theat least one source recorder device and the recording recorder device;computer means for providing selected edit commands; an operatorcontrolled input device including edit function display/indicating meansfor supplying serial edit function messages indicative of selectedediting functions to be performed by the recorder devices and theswitcher device; an operator intelligent line controller coupled to theoperator controlled input device and responsive to the computer meansfor converting the serial edit function messages to a selected andparallel form and for buffering the messages for subsequent use asparallel edit function messages; interfaces coupled to respectiverecorder devices and switcher devices for translating commands to aselected form commensurate with the requirements of the respectivedevices and for returning serial device edit status messages indicativeof the status of the respective devices; and device intelligent linecontrollers coupling the operator intelligent line controller with theinterfaces and responsive to the computer means for establishingcommunication with the recorder and switcher devices via the respectiveinterfaces, for converting the computer means edit commands to serialedit commands and the serial device edit status messages back toparallel device edit status messages, and for buffering the commands andmessages in response to the computer means.